PC T WORLD INTELLECTUAL PROPERTY ORGANIZATION 

International Bureau 



INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification 7 : 
H04M 3/00 


A2 


(11) International Publication Number: WO 00/44151 
(43) International Publication Date: 27 July 2000 (27.07.00) 


(21) International Application Number: PCT/JP00/00261 

(22) International Filing Date: 20 January 2000 (20.0 LOO) 

(30) Priority Data: 

1 1/14840 22 January 1999 (22.01.99) JP 
1 1/332459 24 November 1 999 (24.1 1.99) JP 

(71) Applicant: SONY COMPUTER ENTERTAINMENT INC. 

[JP/JP]; 1-1, Akasaka 7-chome, Minato-ku, Tokyo 
107-0052 (JP). 

(72) Inventors: KAWAI, Eiji; Sony Computer Entertainment Inc., 

1-1, Akasaka 7-chome, Minato-ku, Tokyo 107-0052 (JP), 
ITO, Takeshi; Sony Computer Entertainment Inc., 1-1, 
Akasaka 7-chome, Minato-ku, Tokyo 107-0052 (JP). 

(74) Agent: CHIBA, Yoshihiro; Shinjuku Maynds Tower 16F, 1-1, 
Yoyogi 2-chome, Shibuya-ku, Tokyo 151-0053 (JP). 


(81) Designated States: AU, BR, CA, CN, KR, MX, NZ, RU, SG, 
European patent (BE, CH, DE, DK, ES, FI, FR, GB, IT, 
NL, SE). 

Published 

Without international search report and to be republished 
upon receipt of that report. 



(54) Title: ELECTRONIC MAIL ADVERTISEMENT SYSTEM, BIDIRECTIONAL REAL-TIME COMMUNICATION ADVERTISE- 
MENT SYSTEM AND RELAY DEVICE 





(57) Abstract 



A high noticeable, highly efficient advertisement medium is provided using portable terminals. Electronic mail data (106) is sent 
from a sender's terminal (16A) via a PHS network (12) to a receiver's terminal (16B). A relay device (22) adds advertisement data (108) to 
the electronic mail data (106), producing electronic mail data (110) including the added advertisement data (108), and sends the electronic 
mail data (110) to the receiver's terminal (16B) and the sender's terminal (16A). Each of the receiver's terminal (16B) and the sender's 
terminal (16A) displays an electronic mail message (120) and an advertisement message (122) simultaneously on its display unit. 



FOR THE PURPOSES OF INFORMATION ONLY 



Codes used to identify States party to the PCT on the front pages of pamphlets publishing international applications under the PCT. 



AL 


Albania 


ES 


Spain 


LS 


Lesotho 


SI 


Slovenia 


AM 


Armenia 


FI 


Finland 


LT 


Lithuania 


SK 


Slovakia 


AT 


Austria 


FR 


France 


LU 


Luxembourg 


SN 


Senegal 


ATJ 


Australia 


GA 


Gabon 


LV 


Latvia 


SZ 


Swaziland 


AZ 


Azerbaijan 


GB 


United Kingdom 


MC 


Monaco 


TD 


Chad 


BA 


Bosnia and Herzegovina 


GE 


Georgia 


MD 


Republic of Moldova 


TG 


Togo 


BB 


Barbados 


GH 


Ghana 


MG 


Madagascar 


TJ 


Tajikistan 


BE 


Belgium 


GN 


Guinea 


MK 


The former Yugoslav 


TM 


Turkmenistan 


BF 


Burkina Faso 


GR 


Greece 




Republic of Macedonia 


TR 


Turkey 


BG 


Bulgaria 


HU 


Hungary 


ML 


Mali 


TT 


Trinidad and Tobago 


BJ 


Benin 


IE 


Ireland 


MN 


Mongolia 


UA 


Ukraine 


BR 


Brazil 


IL 


Israel 


MR 


Mauritania 


UG 


Uganda 


BY 


Belarus 


IS 


Iceland 


MW 


Malawi 


US 


United States of America 


CA 


Canada 


IT 


Italy 


MX 


Mexico 


uz 


Uzbekistan 


CF 


Central African Republic 


JP 


Japan 


NE 


Niger 


VN 


Viet Nam 


CG 


Congo 


KE 


Kenya 


NL 


Netherlands 


YU 


Yugoslavia 


CH 


Switzerland 


KG 


Kyrgyzstan 


NO 


Norway 


zw 


Zimbabwe 


CI 


Cdte d'lvoire 


KP 


Democratic People's 


NZ 


New Zealand 






CM 


Cameroon 




Republic of Korea 


PL 


Poland 






CN 


China 


KR 


Republic of Korea 


PT 


Portugal 






cu 


Cuba 


KZ 


Kazakstan 


RO 


Romania 






cz 


Czech Republic 


LC 


Saint Lucia 


RU 


Russian Federation 






DE 


Germany 


LI 


Liechtenstein 


SD 


Sudan 






DK 


Denmark 


LK 


Sri Lanka 


SE 


Sweden 






EE 


Estonia 


LR 


Liberia 


SG 


Singapore 







WO 00/44151 



- 1 - 



PCT/JPOO/00261 



DESCRIPTION 

ELECTRONIC MAIL ADVERTISEMENT SYSTEM, 
BIDIRECTIONAL REAL-TIME COMMUNICATION ADVERTISEMENT SYSTEM 
5 AND RELAY DEVICE 

Technical Field 

The present invention relates to an electronic mail ad- 
vertisement system and a relay device which use a public 
network as a communication infrastructure to provide new 
services in exchanging messages between interconnected ter- 
minals . 

The present invention is also concerned with a bidirec- 
tional real-time communication advertisement system which 
uses a public network as a communication infrastructure to 
provide new services when a sender and a receiver perform 
real-time communications using terminals that bidirectional - 
ly communicate with each other to transmit at least image 
data therebetween, as with a video telephone system or the 
like. 

Background Art 

Portable telephone systems, PHS (Personal Handyphone 
System), and electronic mail (e-mail) systems are finding 
25 growing use as communication means for establishing connec- 
tions between two stations via a public network, i.e., 
point-to-point connections . 

In order for a user to receive services of such a sys- 
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tern, the user usually needs to pay a fixed charge per month 
and, in addition, an access charge (communication charge) 
each time they access the system. 

Recently, the Internet has been seeing the advent of 
5 banner advertisements on WWW (World-Wide Web) pages and 

electronic mail advertisements using electronic mail maga- 
zines. The WWW pages and the electronic mail magazines are 
drawing much attention as new advertisement mediums on the 
Internet . 

10 However, because those who see banner advertisements 

and electronic mail advertisements on electronic mail maga- 
zines are limited to personal computer users, the new adver- 
tisement mediums fail to be more noticeable to general con- 
sumers than conventional advertisement mediums such as di- 

15 rect mail, etc. 

It is therefore an object of the present invention to 
provide an electronic mail advertisement system which makes 
it possible to attach advertisement data to electronic mail 
that is highly noticeable, 

20 Another object of the present invention is to provide a 

bidirectional real-time communication advertisement system 
which uses terminals that bidirectionally communicate with 
each other to transmit at least image data therebetween, as 
with a video telephone system or the like, the bidirectional 

25 real-time communication advertisement system being capable 
of attaching advertisement data to the image data. 

Disclosure of Invention 
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According to the present invention, an electronic mail 
advertisement system comprises a relay device for accessing 
a database is connected to a public network. The relay de- 
vice adds advertisement data from the database to electronic 
5 mail data sent from a sender's terminal, and sends the elec- 
tronic mail data and the advertisement data added thereto to 
a receiver's terminal. 

With the above arrangement, advertisement data can be 
added to highly noticeable electronic mail data sent to the 

10 receiver's terminal. 

The relay device sends either the electronic mail data 
and the advertisement data added thereto or the advertise- 
ment data to the sender's terminal while the sender's termi- 
nal is being connected to the public network for sending 

15 electronic mail. Therefore, advertisement data can also be 
added to highly noticeable electronic mail data sent to the 
sender's terminal. 

The sender's terminal may add display format informa- 
tion of the sender's terminal to the electronic mail data, 

20 and send the electronic mail data and the display format in- 
formation added thereto as electronic mail data with the 
display format information. The relay device may extract 
advertisement data depending on the display format informa- 
tion from the database. 

25 The public network may have a plurality of base sta- 

tions having respective databases and relay devices for ac- 
cessing the databases, respectively. The base station 
which handles a sender's terminal may send electronic mail 
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data sent from the sender's terminal via the public network 
to the base station which handles a receiver's terminal. 
The relay device of the base station which handles the re- 
ceiver's terminal may add advertisement data from the da- 
5 tabase to the electronic mail data and send the electronic 
mail data and the advertisement data added thereto from the 
base station which handles the receiver's terminal to the 
receiver's terminal. With this arrangement, no undue burden 
is imposed on the public network. 

10 The relay device of the base station which handles the 

sender's terminal may send either the electronic mail data 
and the advertisement data added thereto or the advertise- 
ment data to the sender's terminal. 

The sender's terminal may add display format informa- 

15 tion of the sender's terminal to the electronic mail data, 
and sending the electronic mail data and the display format 
information added thereto as electronic mail data with the 
display format information, and each of the relay devices 
may extract advertisement data depending on the display for- 

20 mat information from the corresponding database. 

A bidirectional real-time communication advertisement 
system according to the present invention comprises a public 
network having a database and a relay device for accessing 
the database, and a sender's terminal and a receiver's ter- 

25 minal for transmitting at least image data bidirectionally 

via the public network. The relay device adds advertisement 
data from the database to image data sent from the sender's 
terminal, and sends the image data and the advertisement da- 
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ta added thereto to the receiver's terminal. The receiver's 
terminal allows the receiver to view an image sent from the 
sender's terminal and also an advertisement. 

The relay device may add advertisement data from the 
5 database to image data sent from the receiver's terminal, 
and send the image data and the advertisement data added 
thereto to the sender's terminal. The sender's terminal al- 
lows the sender to view an image sent from the receiver ' s 
terminal and also an advertisement. 

10 The public network may have a plurality of exchanges 

having respective databases and relay devices for accessing 
the databases, respectively. The exchange which handles the 
sender's terminal may send image data sent from the sender's 
terminal via the public network to the exchange which han- 

15 dies the receiver's terminal. The relay device of the ex- 
change which handles the receiver's terminal may add adver- 
tisement data from the database to the image data and send 
the image data and the advertisement data added thereto from 
the exchange which handles the receiver's terminal to the 

20 receiver's terminal. With this arrangement, no undue burden 
is imposed on the public network. 

The sender's terminal may add display format informa- 
tion of the sender's terminal to the image data, and send 
the image data and the display format information added 

25 thereto as electronic mail data with the display format in- 
formation. Each of the relay devices may extract advertise- 
ment data depending on the display format information from 
the corresponding database. 
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The above and other objects, features, and advantages 
of the present invention will become more apparent from the 
following description when taken in conjunction with the ac- 
companying drawings in which preferred embodiments of the 
present invention are shown by way of illustrative example. 

Brief Description of Drawings 

FIG. 1 is a schematic diagram of an electronic mail ad- 
vertisement system according to an embodiment of the present 
invention; 

FIG. 2 is a block diagram showing an electric arrange- 
ment of a terminal used in the electronic mail advertisement 
system shown in FIG. 1; 

FIG. 3 is a front elevational view of the terminal; 

FIG. 4 is a flowchart of an operation sequence of the 
electronic mail advertisement system; 

FIG. 5A is a diagram showing details of electronic mail 
data sent from a sender's terminal 

FIG. 5B is a diagram showing details of electronic mail 
data sent from a relay device; 

FIG. 5C is a diagram showing details of electronic mail 
data received by a receiver's terminal; 

FIG. 6 is a view showing a displayed image for mail 
preparation; 

FIG. 7 is a diagram showing display format bits; 

FIG. 8 is a schematic diagram showing electronic mail 
flows between the sender's terminal, the relay device, and 
the receiver's terminal in the electronic mail advertisement 
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system; 

FIG. 9 is a view showing an image displayed on the re- 
ceiver's terminal; 

FIG. 10 is a view showing an image displayed on the 
5 sender ' s terminal ; 

FIG. 11 is a schematic diagram of an electronic mail 
advertisement system according to another embodiment of the 
present invention; 

FIG. 12 is a block diagram of a bidirectional real-time 
10 communication advertisement system according to an embodi- 
ment of the present invention; 

FIG. 13 is a block diagram showing an electric arrange- 
ment of a terminal used in the bidirectional real-time com- 
munication advertisement system illustrated in FIG. 12; 
15 FIG. 14A is a diagram showing details of video tele- 

phone data sent from a terminal; 

FIG. 14B is a diagram showing details of video tele- 
phone data sent from a relay device; and 

FIG. 15 is a block diagram of a bidirectional real-time 
20 communication advertisement system according to another em- 
bodiment of the present invention. 

Best Mode for Carrying Out the Invention 

Like or corresponding parts are denoted by like or cor- 
25 responding reference characters throughout views. 

FIG. 1 schematically shows an electronic mail adver- 
tisement system 10 according to an embodiment of the present 
invention. 
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In FIG. l r the electronic mail advertisement system 10 
uses a public network, i.e., a PHS network 12, as a communi- 
cation infrastructure. The public network is not limited to 
the PHS network 12, but may be an analog public circuit net- 
5 work (so-called telephone network), a mobile communication 
network which uses mobile telephone terminals, an ISDN, a 
CATV network, or a satellite circuit. 

As shown in FIG. 1, the PHS network 12 has a circuit 
14, which is schematically illustrated, including an ex- 

10 change 15 and a controller 18. To the circuit 14, there are 
connected a plurality of (four in FIG. 1) base stations 20A, 
20B, 20C, 20D (also collectively referred to as "20*). 

In combination with the PHS network 12 composed of the 
exchange 15, the controller 18, the circuit 14, and the base 

15 stations 20, there are used two electronic mail terminals 

(sender 's /receiver ' s terminals) 16A, 16B (also collectively 
referred to as w 16") which comprise PHS terminals. In FIG. 
1, the electronic main terminal 16A serves as a sender's 
terminal 16A, and the electronic main terminal 16B serves as 

20 a receiver's terminal 16B. 

Each of the sender 9 s /receiver ' s terminals 16 comprises 
a portable information terminal in the form of a PHS termi- 
nal, and can be moved around for use by the user. Each of 
the sender ' s /receiver ' s terminals 16 exchange a control sig- 

25 nal with a closest base station 20 at all times to indicate 
its own location to the controller 18. The receiver's ter- 
minal 16B may comprise a pager having a signal reception ca- 
pability only. 
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A relay device 22 as an access point which comprises a 
host computer 23 as a control means is connected to the cir- 
cuit 14 of the PHS network 12. To the relay device 22, 
there is connected an advertisement database (a collection 
5 of advertisement data) 24 as a data storage means that is 

accessible by the relay device 22. The advertisement data- 
base 24 can be updated by the host computer 23 based on the 
demand from an advertiser or a guidance information provider 
supplied via the PHS network 12. 

10 The host computer 23 comprises a keyboard 23K as an in- 

put means, a computer unit 23M having a memory 28 as a non- 
volatile memory means such as a flash memory, a hard disk, 
or the like, and a display unit 2 3D. 

FIG. 2 shows in block form a basic electric arrangement 

15 of each of the sender ' s /receiver ' s terminals 16 as elec- 
tronic mail terminals of the electronic mail advertisement 
system 10. FIG. 3 shows each of the sender's/receiver's 
terminals 16 in front elevation. Each of the 
sender's /receiver's terminals 16 comprises a PHS terminal 

20 which is specially designed as a dedicated terminal for pre- 
paring and displaying electronic mail. 

As shown in FIG. 2, the sender ' s /receiver ' s terminal 16 
has a controller 40 comprising a microcomputer which in- 
cludes an MPU corresponding to a CPU and a memory 42 as a 

25 nonvolatile memory means such as a flash memory. 

To the controller 40, there are connected, as human in- 
terfaces, a command unit 50 having command switches, a 
speaker 46, and a display unit 48 comprising a color liquid 
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crystal display unit. 

As shown in FIG, 3, the command unit 50 has a cross key 
50Cr for selecting characters for the preparation of elec- 
tronic mail messages, a decision key SOD, a cancel key 50Ca, 
and a mode changing key 50M. These keys are keys with com- 
posite functions, and can function as an on-hook key, an 
off -hook key, or a power supply key (power supply on/ off 
keys). However, a power supply key should preferably be 
provided independently. An electronic mail message prepared 
on the terminal 16 is temporarily stored in the memory 42 
shown in FIG. 2. 

As shown in FIG. 2, the sender ' s /receiver ' s terminal 16 
includes a receiver 54, connected to the controller 40, for 
receiving a radio wave (RF signal) containing electronic 
mail data from an antenna 64 via an antenna sharing unit 66, 
converting the RF signal into an intermediate- frequency sig- 
nal, demodulating the intermediate -frequency signal, and 
outputting the demodulated signal as received electronic 
mail data to the controller 40. The controller 40 monitors 
the receiver 54 for a signal at constant periodic intervals, 
controls the receiver 54 to receive a signal when an elec- 
tronic mail message is transmitted, and controls the display 
unit 48 to display the electronic mail message. 

The sender ' s /receiver ' s terminal 16 also includes a 
transmitter 56, connected to the controller 40, for modulat- 
ing electronic mail data read from the memory 42, changing 
the modulated electronic mail data from an intermediate- 
frequency signal to an RF signal, and radiating the RF sig- 
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nal via the antenna sharing unit 66 as a radio wave from the 
antenna 64. 

A frequency synthesizer 58 for outputting a local fre- 
quency for a mixer in each of the receiver 54 and the trans - 
5 mitter 56 is also connected to the controller 40. 

The sender ' s /receiver's terminal 16 also has a power 
supply circuit (not shown) for supplying electric energy to 
the various circuits therein, and a cell (not shown), e.g., 
a secondary cell, for supplying electric energy to the power 

10 supply circuit. 

As shown in FIG. 3, the sender ' s /receiver ' s terminal 16 
has a casing 70 which is substantially of an elliptical 
shape with a flat bottom. The casing 70 supports thereon 
the command unit 50 (the keys 50Ca, 50Cr, SOD and 50M) , the 

15 display unit 48, and the antenna 64 that is extensible and 

contractible . Actually, the sender ' s /receiver ' s terminal 16 
is of a thin, flat configuration and has a size substantial- 
ly equal to or smaller than a palm of the user's hands, as 
viewed in front elevation. 

20 Operation of the electronic mail advertisement system 

10, which is substantially of the above structure, will be 
described below with reference to an operation sequence 
shown in FIG. 4. 

In this embodiment, it is assumed that an electronic 

25 mail message is to be sent from the sender's/ 

receiver's terminal 16A, which is carried by Taro, the 
sender, to the sender's/receiver's terminal 16B, which is 
carried by Hanako , the receiver . 
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For an easier understanding, the sender*/ 
receiver's terminal 16A will be referred to as a sender's 
terminal 16A, the sender ' s /receiver ' s terminal 16B as a re- 
ceiver's terminal 16B, the display unit 48 of the sender's 
5 terminal 16A as a display unit 48A, and the display unit 48 
of the receiver's terminal 16B as a display unit 48B. Simi- 
larly, other components of the sender's terminal 16A are de- 
note by their reference numerals with a suffix "A", and oth- 
er components of the sender's terminal 16B are denoted by 

10 their reference numerals with a suffix "B". 

In step SI shown in FIG. 4, the command unit 50 is op- 
erated to generate electronic mail body data 104. 

As shown in FIG. 5A, the electronic mail body data 104 
includes a destination (an electronic mail address and the 

15 receiver's name, Hanako, read from the electronic mail ad- 
dress), a sender (Taro that is automatically attached), and 
a mail text (e.g., "Tomorrow's meeting spot will be changed 
to the west exit"). 

To prepare the mail text, an image 82 for mail prepara- 

20 tion is displayed on the screen of the display unit 48A, as 
shown in FIG. 6. The displayed image 82 includes a mail 
text display section 84, an alphabetical character display 
section 86, and an OK (approval) display section 88. The 
sender operates the cross key 50Cr of the command unit 50 to 

25 select a character from the alphabetical character display 
section 86, and operates the decision key SOD to enter the 
selected character into the mail text display section 84. 
To cancel an entered character, the sender operates the can- 
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eel key 50Ca. The mode changing key 50M is used to switch 
between a mode to enter the alphanumeric characters and a 
mode to enter special symbols. 

To the electronic mail body data 104, which includes 
5 the mail text thus prepared, there are automatically added 
display format bits 101, as shown in FIG. 5A. The elec- 
tronic mail body data 104 and the display format bits 101 
added thereto jointly make up electronic mail data 106 which 
is stored in the memory 42. The electronic mail data 106 is 
10 also referred to as electronic mail data 106 with a display 
format . 

Thereafter, the sender selects the OK display section 
88 with the cross key 50Cr and decides on the OK display 
section 88 with the decision key SOD for thereby entering a 
15 key command for sending the mail text. The electronic mail 
data 106 which is stored in the memory 42 is now sent from 
the transmitter 56 via the antenna sharing unit 66 to the 
antenna 64, from which it is radiated as a radio wave, in 
step S2. 

20 The display format bits 101 represent a display format 

for the display unit 48A of the sender's terminal 16A. In 
this embodiment, as shown in FIG. 7, the display format bits 
101 include a high-order bit and a low-order bit which, in 
combination, represent one of four display formats. 

25 Specifically, the display format bits 101 - "00" repre- 

sent a display format having 128 x 128 pixels, 256 display 
colors, and a display rate of 100 ns. 

The display format bits 101 « "01" represent a display 
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format having 32 x 32 pixels, monochromatic display colors, 
and a display rate of 60 ns. 

The display format bits 101 = "10" represent a display 

format having 320 x 240 pixels, 4096 display colors, and a 
5 display rate of 200 ns . 

The display format bits 101 = "11" represent an NTSC 
display format. 

Since the sender ' s /receiver ' s terminals 16 are designed 
to send and receive electronic mail via the relay device 22, 
10 an identification number representing the address of the 

host computer 23 of the relay device 22 is automatically in- 
serted into a header (not shown) of the electronic mail data 
106. 

When the electronic mail data 106 is sent to the cir- 
15 cult 14, the exchange 15 refers to the header of the elec- 
tronic mail data 106, and sends the electronic mail data 106 
to the host computer 23 of the relay device 22. 

FIGS. 5A, 5B, and 5C show an example of electronic mail 
data transmitted through the PHS network 12. 
20 As described above, FIG. 5A schematically shows the 

electronic mail data 106 which is sent from the sender's 
terminal 16A via the base station 20A to the circuit 14 of 
the PHS network 12. It is assumed that data depending on 
the communication infrastructure, such as a physical address 
25 and communication negotiations, inserted in the header are 
omitted for the sake of brevity. The electronic mail data 
106 sent from the sender's terminal 16A, i.e., the sender, 
to the relay device 22 is composed of the electronic mail 
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body data 104 including the destination (receiver) , the 
sender, and the mail text, and the display format bits 101 
added to the electronic mail body data 104. Details of data 
shown in FIGS. 5B and 5C will be described later on. 
5 The relay device 22 performs a predetermined processing 

operation in step S3, 

Specifically, the host computer 23 of the relay device 
22 refers to the display format bits 101 contained in the 
electronic mail data 106 from the sender's terminal 16A, ac- 
10 cesses the advertisement database 24, and extracts adver- 
tisement data which comprises image data matching the dis- 
play format represented by the display format bits 101. 

The host computer 23 then adds extracted advertisement 
data 108 (see FIG. 5B) to the electronic mail data 106, thus 
15 generating new electronic mail data (also referred to as 

"combined electronic mail data") 110. The host computer 23 
sends the new electronic mail data 110 to the circuit 14 for 
transmission to the receiver's terminal 16B. 

As shown in FIG. 5B, the advertisement data 108 may be 
20 arranged to contain a moving image, a still image, charac- 
ters, symbols, and/or a banner advertisement. 

In the electronic mail data 106 f 110 shown in FIGS. 5A 
and 5B, the mail text of the electronic mail body data 104 
should preferably be encrypted so that it cannot be read by 
25 the relay device 22. 

The relay device 22 also generates, in addition to the 
electronic mail data 110 shown in FIG. 5B, electronic mail 
data 112 including the display format bits 101 and adver- 
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tisement data 108 only and having the sender's terminal 16A 
as its destination. The electronic mail data 112 may also 
contain the electronic mail body data 104 in addition to the 
display format bits 101 and the advertisement data 108. 
5 In step S4, the relay device 22 sends the electronic 

mail data. Specifically, as shown in FIG. 8 r when the relay 
device 22 sends the electronic mail data 110 including the 
advertisement data 108 to the circuit 14, the exchange 15 
refers to the controller 18, confirms the location of the 

10 receiver's terminal 16B, and sends the combined electronic 

mail data 110, which comprises the electronic mail body data 
104, the advertisement data 108, and the display format bits 
101, as a radio wave via the base station 20C to the re- 
ceiver's terminal 16B. 

15 A t the same time, while the sender's terminal 16A is 

being connected to the circuit 14 for electronic mail trans- 
mission, the relay device 22 sends the electronic mail data 
112 including the advertisement data 108 via the circuit 14 
as a radio wave from the base station 20A to the sender's 

20 terminal 16A. 

After having sent these electronic mail data, the relay 
device 22 is disconnected from the circuit 14. 

Although not shown for the sake of brevity, the elec- 
tronic mail data are actually sent via mail servers to the 

25 sender 's /receiver ' s terminals 16A, 16B. 

In step S5, the combined electronic mail data 110 is 
received by the antenna 64B of the receiver's terminal 16B, 
and supplied via the antenna sharing unit 66B and the re- 
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ceiver 54B to the controller 40B in which the combined elec- 
tronic mail data 110 is stored in the memory 42B. The con- 
troller 40B controls the speaker 46B to announce the recep- 
tion of the combined electronic mail data 110, and also con- 
5 trols the display unit 48B to display information represent- 
ed by the combined electronic mail data 110. 

For displaying the information represented by the com- 
bined electronic mail data 110, the controller 40B refers to 
the display format bits 101 in the combined electronic mail 

10 data 110 to determine the display format for the attached 

advertisement data 108, converts the advertisement data 108 
into image data matching the display format (stored in the 
memory 42B) of the display unit 48B of the receiver's termi- 
nal 16B, and displays the image data on the display unit 

15 48B. The controller 40B converts the advertisement data 108 
into image data by interpolating or decimating the adver- 
tisement data 108, for example. In this manner, the re- 
ceiver's terminal 16B determines the display format bits 101 
to display an image that matches the display format of the 

20 display unit 48B of the receiver's terminal 16B. 

If the display units 48 of the terminals 16, i.e., the 
sender's terminal 16A and the receiver's terminal 16B, used 
in the electronic mail advertisement system 10 have one dis- 
play format, then since no display format is required to be 

25 determined, the display format bits 101 do not need to be 
stored and attached. 

The electronic mail data 112 is received by the antenna 
64A of the sender's terminal 16A, and supplied via the an- 
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tenna sharing unit 66A and the receiver 54A to the control- 
ler 4 OA in which the electronic mail data 112 is stored in 
the memory 42A. The controller 40A controls the speaker 46A 
to announce the reception of the electronic mail data 112, 
5 and also controls the display unit 48A to display informa- 
tion represented by the electronic mail data 112. 

Specific examples of displayed images will be described 
below. As shown in FIG. 9, the display unit 48B of the re- 
ceiver's terminal 16B displays an image 124 including a mes- 

10 sage 120 "FROM: Taro Tomorrow's meeting spot will be 

changed to the west exit" corresponding to the electronic 
mail body data 104, an advertisement message 122 "New auto 
convention next Saturday and Sunday ! ABC Motors" together 
with an automobile icon corresponding to the advertisement 

15 data 108. 

As shown in FIG. 10, the display unit 48A of the 
sender's terminal 16A displays an image 128 including a mes- 
sage 126 "TO: Hanako Now Transmitting • • • " corresponding to 
the header (not shown) , together with a transmission pro- 

20 gress rate indicator in the form of a plurality of (six in 
FIG. 10) uniformly directed triangular marks, four of which 
are highlighted to indicate a transmission progress rate of 
4/6, and the advertisement message 122 together with an 
automobile icon corresponding to the advertisement data 108. 

25 From the displayed images 124, 148 shown in FIGS . 9 and 

10, the sender and the receiver can understand the contents 
of the electronic mail and also see the advertisement mes- 
sage 122 displayed in combination with the electronic mail 
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that is highly noticeable. 

If the advertisement message 122 is displayed based on 
banner advertisement data, then the sender or the receiver 
can operate the command unit 50 (50A, 50B) for a mouse click 
to access the home page of the advertiser, which is linked 
to the advertisement message 122, via the circuit 14, and 
can download detailed data of the home page, in step S6. 
Therefore, the user of the sender ' s /receiver 's terminal 16 
can obtain detailed information of the advertisement message 
122. 

In the electronic mail advertisement system 10 shown in 
FIG. 1, one relay device 22 is connected to the circuit 14. 
However, a plurality of relay devices 22 may be connected to 
the circuit 14. If a plurality of relay devices 22 is con- 
nected to the circuit 14, then the sender's /receiver's ter- 
minals 16 use the closest ones of the relay devices 22. 

In the electronic mail advertisement system 10 shown in 
FIG. 1, furthermore, the relay device 22 is connected as a 
new communication infrastructure to the circuit 14. How- 
ever, the relay device 22 may be integrally combined with or 
additionally connected to each of the base stations 20 or a 
certain one of the base stations 20 or the exchange 15 or 
the controller 18 that is part of the existing communication 
infrastructure, which is the PHS network 12 in the embodi- 
ment shown in FIG. 1. if the existing communication infra- 
structure comprises a mobile communication network of mobile 
telephone terminals, then the relay device 22 may also be 
integrally combined with or additionally connected to each 
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or a certain one of the base stations or a mobile communica- 
tion exchange, 

FIG. 11 schematically shows an electronic mail adver- 
tisement system 10A according to another embodiment of the 
present invention. In FIG. 11, the electronic mail adver- 
tisement system 10A uses a public network 12A such as a PHS 
network or a mobile communication network of mobile telepho- 
ne terminals, which includes a circuit 14 and base stations 
20X, 20Y connected thereto. The base stations 20X, 20Y in- 
corporate integrally therein respective relay devices 22X, 
22 Y including respective host computers 23X, 23Y connected 
to respective advertisement databases 24X, 24Y. 

The electronic mail advertisement system 10A operates 
as follows: When electronic mail data 106 (see FIG. 5A) 
comprising electronic mail body data 104 and display format 
bits 101 is sent as a radio wave from the sender's terminal 
16A, the base station 20X receives the electronic mail data 
106 via an antenna 140, and the relay device 22X of the base 
station 20X accesses the advertisement database 24X, and 
sends electronic mail data 112 comprising advertisement data 
108 corresponding to the display format bits 101 via the an- 
tenna 140 to the sender's terminal 16A. 

The electronic mail data 106 received by the base sta- 
tion 2 OA is sent via the circuit 14 of the public network 
12A to the base station 20Y. The base station 20Y refers to 
the display format bits 101 in the electronic mail data 106, 
accesses the advertisement database 24Y, extracts advertise- 
ment data 108 corresponding to the display format bits 101, 
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and sends electronic mail data 110 (see FIG. 5B) comprising 
the electronic mail body data 104 and the advertisement data 
108 added thereto as a radio wave via an antenna 142 to the 
receiver's terminal 16B. 

With the electronic mail advertisement system 10A shown 
in FIG. 11, the electronic mail data 110 including the ad- 
vertisement data 108 does not pass through the circuit 14, 
but the electronic mail data 106 including only the display 
format bits 101 passes through the circuit 14. Accordingly, 
no undue burden is likely to be imposed on the circuit 14. 

Each of the electronic mail advertisement systems 10, 
10A shown in FIGS. 1 and 11 comprises the 

sender's /receiver's terminals 16 as terminals dedicated for 
electronic mail and the public network 12 such as a PHS net- 
work. However, the sender ' s /receiver ' s terminals 16 are not 
limited to such terminals dedicated for electronic mail, but 
may comprise desired terminals with a display screen, such 
as portable telephone terminals, PHS terminals, or pagers 
connected to the public networks 12, 12A. 

Each of the public networks 12, 12A may comprise, other 
than the portable telephone network or the PHS network, an 
analog public circuit network (conventional telephone net- 
work) , an ISDN, a cable network, a satellite circuit, or any 
other public network. 

In the above embodiments, the transmission of elec- 
tronic mail from one terminal 16A of the sender to one ter- 
minal 16B of the receiver. The present invention is also 
applicable to the transmission of electronic mail from ter- 
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minal of the sender to a plurality of receiver's terminals. 
In the above embodiments, electronic mail is transmit- 
ted unidirectionally from the terminal 16A of the sender to 
the terminal 16B of the receiver. However, the present in- 
5 vention is also applicable to a bidirectional real-time com- 
miinication advertisement system in which the sender and the 
receiver exchange at least image data bidirectionally there- 
between in video telephone or video conference. 

FIG, 12 shows in block form a bidirectional real-time 

10 communication advertisement system 210 according to an em- 
bodiment of the present invention. The bidirectional real- 
time communication advertisement system 210 has video tele- 
phone terminals 216, 217 connected to an ISDN network 212 as 
a public network, and a relay device 22 for accessing an ad- 

15 vertisement database 24, the relay device 22 being connected 
to the ISDN network 212. 

As shown in FIG. 13, each of the video telephone termi- 
nals 216, 217 comprises a controller 240 comprising a micro- 
computer which includes an MPU corresponding to a CPU and a 

20 memory 242 as a nonvolatile memory means such as a flash 
memory . 

To the controller 240, there are connected, as human 
interfaces, a command unit 250 having dial switches includ- 
ing a ten-key pad and a power supply switch, a sound proces- 
25 sor 254 for encoding and decoding sound data, the sound 

processor 254 being connected to a headset 252 having a mi- 
crophone and a speaker, and a video processor 260 for encod- 
ing and decoding video data, the video processor 260 being 
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connected to a video camera 256 and a display unit 258. The 
controller 240 is connected to the ISDN network 212 via an 
interface 262 which comprises an I interface and a DSU. 

The bidirectional real-time communication advertisement 
5 system 210 operates as follows: After a link is established 
through the ISDN network 212, i.e., after a call is con- 
nected, the video telephone terminal 216 (or 217) generates 
video telephone body data 204 comprising sound data and im- 
age data, as shown in FIG. 14A, adds display format bits 101 

10 = "11" representing an NTSC display format (see FIG. 7) to 
the video telephone body data 204, and sends the combined 
data as video telephone data 206 to the ISDN network 212. 

The relay device 22 refers to the display format bits 
101, accesses the advertisement database 24, and extracts 

15 advertisement data 108 corresponding to the display format 
bits 101 from the advertisement database 24. As shown in 
FIG. 14B, the relay device 22 sends video telephone data 211 
comprising the video telephone body data 204, the advertise- 
ment data 108, and the display format bits 101 via the ISDN 

20 network 212 to the other video telephone terminal 217 (or 
216) . 

The bidirectional real-time communication advertisement 
system 210 allows the users of the video telephone terminals 
216, 217 to see an image represented by the video telephone 
25 body data 204, e.g., the face of the other party, together 
with a moving image, a still image, characters, symbols, 
and/or a banner advertisement, on the display units 258. 

The bidirectional real-time communication advertisement 
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system 210 shown in FIG. 12 may have a plurality of relay 
devices 22. With the plural relay devices 22 used, the bur- 
den on the communication circuit of the ISDN network 212 can 
be reduced because the video telephone terminals 216, 217 
5 use the closest ones of the relay devices 22. 

FIG. 15 shows in block form a bidirectional real-time 
communication advertisement system 210A according to another 
embodiment of the present invention. In FIG. 15, the bidi- 
rectional real-time communication advertisement system 210A 

10 includes exchanges 320, 322 connected to the ISDN network 
212 and incorporating integrally therein respective relay 
devices 22P, 22Q including respective host computers 23P, 
23Q connected to respective advertisement databases 24P, 
24Q. The exchange 320 is connected between the video tele- 

15 phone terminal 216 and the ISDN network 212, and the ex- 
change 322 is connected between the video telephone terminal 
217 and the ISDN network 212. 

The bidirectional real-time communication advertisement 
system 210A operates as follows: When video telephone data 

20 206 (see FIG. 14A) comprising video telephone body data 204 
and display format bits 101 are sent respectively from the 
video telephone terminals 216, 217, the video telephone data 
206 are delivered via the ISDN network 212 to the respective 
exchanges 320, 322 which handle the video telephone termi- 

25 nals 216, 217, respectively. 

Stated otherwise, the video telephone data 206 from the 
video telephone terminal 216 is sent via the exchange 320 
and the ISDN network 212 to the exchange 322, and the video 
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telephone data 206 from the video telephone terminal 217 is 
sent via the exchange 322 and the ISDN network 212 to the 
exchange 320, 

The relay device 22Q in the exchange 322 which handles 
the video telephone terminal 217 determines a display format 
from the display format bits 101 in the video telephone data 
206 from the video telephone terminal 216, extracts adver- 
tisement data 108 according to the determined display format 
from the advertisement database 24Q, and generates video 
telephone data 211 which comprises the video telephone body 
data 204, the advertisement data 108, and the display format 
bits 101, as shown in FIG. 14B. The generated video tele- 
phone data 211 is sent from the exchange 322 to the video 
telephone terminal 217, 

The relay device 22P in the exchange 320 which handles 
the video telephone terminal 216 determines a display format 
from the display format bits 101 in the video telephone data 
206 from the video telephone terminal 217, extracts adver- 
tisement data 108 according to the determined display format 
from the advertisement database 24P, and generates video 
telephone data 211 which comprises the video telephone body 
data 204, the advertisement data 108, and the display format 
bits 101, as shown in FIG. 14B. The generated video tele- 
phone data 211 is sent from the exchange 320 to the video 
telephone terminal 216. 

Since the video telephone terminals 216, 217 use the 
closest relay devices 22P, 22Q, the burden on the communica- 
tion circuit of the ISDN network 212 is reduced. 
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In the embodiments according to the present invention, 
it is possible display an advertisement image together with 
an image which is highly noticeable to the user, such as an 
electronic mail message, a video telephone image, or the 
5 like. Because the displayed advertisement image is highly 

probably viewed by the user, the advertiser is given the op- 
portunity to use an advertisement medium that is highly 
cost-effective . 

The service provider of the electronic mail advertise- 

10 ment system 10 can obtain an advertisement income, each user 
can expect the fixed charge per month and the access charge 
(communication charge) to be lowered or eliminated. Conse- 
quently, the present invention can contribute highly to the 
widespread use of the existing electronic mail system among 

15 the general public. 

The bidirectional real-time communication advertisement 
system 210 allows the owner of the relay device 22 to obtain 
an advertisement income, and also allows the owner of the 
ISDN network 212 to receive more payments for communication 

20 charges commensurate with the advertisement income. It is 
highly likely for the bidirectional real-time communication 
advertisement system 210 to create new businesses including 
wider use of video telephone terminals. 

According to the present invention, as described above, 

25 advertisement data is added to and sent together with elec- 
tronic mail that is highly noticeable to the user, by the 
relay device connected to the public network. Therefore, 
the advertisement data is highly probably viewed by the 
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user, and the advertiser is given the opportunity to use an 
advertisement medium that is highly cost-effective. 

Furthermore, in the real-time communication advertise- 
ment system which transmits at least image data bidirection- 
5 ally in a video telephone system, for example, advertisement 
data is added to and sent together with the image data by 
the relay device connected to the public network. Conse- 
quently, the advertisement data is highly probably viewed by 
the user, and the advertiser is given the opportunity to use 

10 an advertisement medium that is highly cost-effective. 

Although certain preferred embodiments of the present 
invention have been shown and described in detail, it should 
be understood that various changes and modifications may be 
made therein without departing from the scope of the append- 

15 ed claims. 
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CLAIMS 

1. An electronic mail advertisement system comprising: 
a public network ( 12 ) ( 14 ) ; 

5 a sender's terminal (16A) for generating, displaying, 

and sending electronic mail; 

at least one receiver's terminal (16B) for receiving 
and displaying electronic mail sent from said sender's ter- 
minal ( 16A) ; 
10 a database (24); and 

a relay device (22) connected to said public network, 
for accessing said database (24), adding advertisement data 
(108) from said database (24) to electronic mail data (104) 
sent from said sender's terminal (16A), and sending the 
15 electronic mail data (104) and the advertisement data (108) 
added thereto to said receiver's terminal (16B). 

2. An electronic mail advertisement system according to 
claim 1, wherein said relay device (22) comprises means for 

20 sending either the electronic mail data (104) and the adver- 
tisement data (108) added thereto or the advertisement data 
(108) to said sender's terminal (16A) while said sender's 
terminal (16A) is being connected to said public network for 
sending electronic mail. 

25 

3. An electronic mail advertisement system according to 
claim 1, wherein said sender's terminal comprises means for 
adding display format information (101) of the sender's ter- 
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mlnal to said electronic mail data (104), and sending said 
electronic mail data (104) and the display format informa- 
tion (101) added thereto as electronic mail data (106) with 
the display format information, and said relay device com- 
prises means for extracting advertisement data depending on 
said display format information from said database. 

4 . An electronic mail advertisement system according to 
claim 2, wherein said sender's terminal comprises means for 
adding display format information (101) of the sender's ter- 
minal to said electronic mail data (104), and sending said 
electronic mail data (104) and the display format informa- 
tion (101) added thereto as electronic mail data (106) with 
the display format information, and said relay device com- 
prises means for extracting advertisement data depending on 
said display format information from said database. 

5. An electronic mail advertisement system comprising: 
a public network (12A) (14) having a plurality of base 

stations (20X), (20Y); 

a sender's terminal (16A) for generating, displaying, 
and sending electronic mail; and 

at least one receiver's terminal (16B) for receiving 
and displaying electronic mail sent from said sender's ter- 
minal (16A); 

said base stations (20X), (20Y) having respective data- 
bases (24X), (24Y) and relay devices (22X), (22Y) for ac- 
cessing said databases (24X), (24Y), respectively; 
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said base station (20X) which handles said sender's 
terminal having means for sending electronic mail data (104) 
sent from said sender's terminal via said public network to 
the base station which handles said receiver's terminal; 
5 said relay device (22Y) of the base station which han- 

dles said receiver's terminal having means for adding adver- 
tisement data (108) from the database (24Y) to said elec- 
tronic mail data (104) and sending said electronic mail data 
(104) and the advertisement data (108) added thereto from 
10 said base station (20Y) which handles said receiver's termi- 
nal to said receiver's terminal. 

6 • An electronic mail advertisement system according to 
claim 5, wherein said relay device (22X) of the base station 
15 which handles said sender's terminal having means for send- 
ing either said electronic mail data and the advertisement 
data added thereto or the advertisement data to said 
sender's terminal. 

20 7. An electronic mail advertisement system according to 

claim 5, wherein said sender's terminal comprises means for 
adding display format information (101) of the sender's ter- 
minal to said electronic mail data (104), and sending said 
electronic mail data (104) and the display format informa- 

25 tion (101) added thereto as electronic mail data (106) with 
the display format information, and each of said relay de- 
vices (22X), (22Y) comprises means for extracting advertise- 
ment data depending on said display format information from 
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the corresponding database* 

8. An electronic mail advertisement system according to 
claim 6, wherein said sender's terminal comprises means for 

5 adding display format information (101) of the sender's ter- 
minal to said electronic mail data (104), and sending said 
electronic mail data (104) and the display format informa- 
tion (101) added thereto as electronic mail data (106) with 
the display format information, and each of said relay de- 
10 vices (22X), (22Y) comprises means for extracting advertise- 
ment data depending on said display format information from 
the corresponding database. 

9. A bidirectional real-time communication advertise- 
15 ment system comprising: 

a public network (210) (212) having a database (24) and 
a relay device (22) for accessing said database (24); and 

a sender's terminal (216) and a receiver's terminal 
(217) for transmitting at least image data bidirectionally 
20 via said public network; 

said relay device (22) having means for adding adver- 
tisement data (108) from said database to image data sent 
from said sender's terminal (216), and sending the image da- 
ta and the advertisement data (108) added thereto to said 
2 5 receiver ' s terminal (217). 

10. A bidirectional real-time communication advertise- 
ment system according to claim 9, wherein said relay device 



WO 00/44151 PCT/JP00/00261 

- 32 - 

(22) having means for adding advertisement data from said 
database to image data sent from said receiver's terminal, 
and sending the image data and the advertisement data added 
thereto to said sender's terminal. 

5 

11. A bidirectional real-time communication advertise- 
ment system comprising: 

a public network (210A) (212) having a plurality of ex- 
changes (320), (322); and 

10 a sender's terminal (216) and a receiver's terminal 

(217) for transmitting at least image data bidirectionally 
via said public network; 

said exchanges (320), (322) having respective databases 
(24P), (24Q) and relay devices (22P), (22Q) for accessing 

15 said databases (24P), (24Q), respectively; 

said exchange (320) which handles said sender's termi- 
nal having means for sending image data (204) sent from said 
sender's terminal via said public network to the exchange 
which handles said receiver's terminal; 

20 said relay device (22Q) of the exchange which handles 

said receiver's terminal having means for adding advertise- 
ment data (108) from the database (24Q) to said image data 
(204) and sending said image data (204) and the advertise- 
ment data (108) added thereto from said exchange which han- 

25 dies said receiver's terminal to said receiver's terminal. 

12. A bidirectional real-time communication advertise- 
ment system according to claim 11, wherein said sender's 
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terminal comprises means for adding display format informa- 
tion (101) of the sender's terminal to said image data 
(204), and sending said image data (204) and the display 
format information (101) added thereto as electronic mail 
data (206) with the display format information, and each of 
said relay devices (22P), (22Q) comprises means for extract- 
ing advertisement data depending on said display format in- 
formation from the corresponding database, 

13. A relay device (22) connected to a public network 
(12) (14), for accessing a database (24) comprising: 

means for adding advertisement data (108) from said da- 
tabase to electronic mail data (104) sent from a sender's 
terminal (16A) through said public network; 

means for extracting advertisement data and/or guide in- 
formation data (108) matching said attributes from said data- 
base; 

means for sending resultant electronic mail data (110) 
to said receiver's terminal (16B) through said public net- 
work . 

14. A relay device according to claim 13, wherein said 
means for sending either the electronic mail data (104) and 
the advertisement data (108) added thereto or the advertise- 
ment data (108) to said sender's terminal through said public 
network while said sender's terminal is being connected to 
said public network for sending electronic mail* 
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FIG.4 
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FIG. 6 
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FIG. 7 
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